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CHAOTIC BEHAVIOR OF GROUP ACTIONS 


ZHAOLONG WANG AND GUOHUA ZHANG * * 


Abstract. In this paper we study chaotic behavior of actions of a countable 
discrete group acting on a compact metric space by self-homeomorphisms. 

For actions of a countable discrete group G, we introduce local weak mixing 
and Li-Yorke chaos; and prove that local weak mixing implies Li-Yorke chaos if 
G is infinite, and positive topological entropy implies local weak mixing if G is 
an infinite countable discrete amenable group. Moreover, when considering a 
shift of finite type for actions of an infinite countable amenable group G , if the 
action has positive topological entropy then its homoclinic equivalence relation 
is non-trivial, and the converse holds true if additionally G is residually finite 
and the action contains a dense set of periodic points. 


1. Introduction 

The topological theory of dynamical systems concentrates on the study of qual¬ 
itative aspects of dynamics of continuous transformations by various topological 
tools. Recently, the notion of weakly mixing subsets (of all orders) was introduced 
for dynamical systems (of N-actions) by Blanchard and Huang in [5], which mea¬ 
sures local complexity of the structure of orbits. It was proved that every N-action 
with positive topological entropy has a non-trivial so-called weakly mixing subset 
(of all orders) [5j Theorem 4.5]. For a better understanding of the dynamics over 
subsets, in [31] Oprocha and the second author of the present paper introduced the 
notion of weakly mixing subsets of order n for any given n £ N. Generally speaking, 
a weakly mixing subset A mimics the synchronization of transfer times of continu¬ 
ous transformations, but this synchronization is local, possibly only for open subsets 
intersecting A. As shown by results in a series of papers [50; [51, [521 ESj, though 
the definition of weakly mixing subsets is analogous to the case of transformations, 
dynamical properties of weakly mixing subsets are much harder to manage even we 
consider dynamical systems of N-actions. For example, it is well known that weak 
mixing of order 2 is equivalent to weak mixing of all orders for a single transfor¬ 
mation El- While, this is no longer true for weakly mixing subsets as shown by 
[501 EH, in fact, for each n > 2 there are minimal dynamical systems of N-actions 
which contain non-trivial weakly mixing subsets of order n and all weakly mixing 
subsets of order n + 1 in the systems are trivial m- There are many other richer 
dynamics over weakly mixing subsets observed in [30l EH |32j [33]. 

It is very natural to generalize the definition of weakly mixing subsets from fr¬ 
actions to actions of a countable discrete group acting on a compact metric space. 
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Throughout the whole paper, G will he a countable discrete group, and ( X , G) 
will be a G-system in the sense that the group G acts on a compact metric space 
X (with metric p) as a group of self-homeomorphisms of the space X. We shall 
write g : X —y X, x i —y gx\ and naturally ( X m ,G),m £ N will be a G-system with 
q : X m —>• X m , (x\, ■ ■ ■ , x m ) i-> (qx i, • • • , qx m ) for all q £ G and x, X\, ■ ■ ■ , x m £ X. 

For 0 ^ I<i, K 2 C X and x £ X we set N{K 1 ,K 2 ) = {g £ G : gKA n K 2 ± 0} 
and N(x,K 2 ) = N({x},K 2 ) = {g £ G : gx £ AT 2 }. Let 0 ^ AT C X. We say AT 
trivial if it is a singleton; else, we say K non-trivial. Let n £ N. Following nans], 
we say that AT is weakly mixing of order n if N{JJ\C\K, V{) n- • • nN(U n nAT, V n ) ^ 0 
whenever all - ■ ■ ,U n ,V n are open subsets of X intersecting AT; and weakly 

mixing (of all orders) if it is weakly mixing of order m for each m £ N. Observe 
that, K is weakly mixing of order n if and only if the closure of K is weakly mixing 
of order n, and weak mixing of order n + 1 implies weak mixing of order n. 

Then we can generalize [5] Theorem 4.5] to a more general setting if the group 
G is good enough (in the sense that it is an infinite countable amenable group). 

Theorem 1.1. Assume that the system (X, G) has positive topological entropy, 
where G is an infinite countable discrete amenable group. Then it admits a non¬ 
trivial weakly mixing subset of all orders. In fact, 

htop(G, X) = sup{/it op (G, K) : 0 ^ K C X is weakly mixing of all orders }. 

In the setting of dynamical systems of N-actions, the notion of weakly mixing 
subsets always involves complicated dynamics of the given system, for example, the 
existence of a non-trivial weakly mixing set implies chaos in the sense of Li and 
Yorke [5] Definition 4.1] and [30] Proposition 5.1] (in fact, it reflects a much stronger 
chaos as shown by m Theorem 5.3]). Consequently, each dynamical system of an 
N-action with positive topological entropy is Li-Yorke chaotic, which was observed 
first by Blanchard, Glasner, Kolyada and Maass in [2j. 

The definition of Li-Yorke chaos can be generalized to actions of a countable 
discrete group [22] as follows. We say that (x\,x 2 ) £ X 2 is a Li-Yorke pair if 

limsup p{gx\, gx 2 ) > 0 and liminf p(gxi, gx 2 ) = 0, 

oo G3g^oo 

where the limit supremum and limit infimum mean the limits of 

sup p{gx 1 ,gx 2 ) and inf p(gxi,gx 2 ), 
g eG\F g£G\F 

respectively, over the net of F £ Tq. Where, we denote by Tq the set of all non¬ 
empty finite subsets of G. In fact, this is equivalent to say that (x\,x 2 ) £ X 2 is a 
Li-Yorke pair if and only if there exists a sequence {g n : n £ N} of distinct elements 
of G and a sequence {g' n : n £ N} of distinct elements of G such that 

limsup p(g n x:i, gnX 2 ) > 0 and liminf p{g' n xi, g' n x 2 ) = 0, 

n—too n—too 

respectively. We say that the G-system ( X , G) is Li- Yorke chaotic if there exists 
an uncountable subset Z C X such that every non-diagonal pair (xi,x 2 ) £ Z 2 is 
a Li-Yorke pair. Obviously, the definitions of Li-Yorke pairs and Li-Yorke chaos 
work only for an infinite group G. These definitions came from [24] , and their 
relationship with entropy of a G-system was explored first for Z-actions in [2] and 
then for actions of an infinite countable sofic group recently by Kerr and Li in [22| . 

As shown by Theorem 11.21 weakly mixing subsets also present chaotic behavior 
of actions even we consider dynamical systems of a countable discrete group. 
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Theorem 1.2. A ssume that ( X , G) admits a non-trivial weakly mixing subset of 
order 2. Then G is infinite and ( X , G) is Li- Yorke chaotic. 

And then as a direct corollary of Theorem 11.11 and Theorem 1 1.21 we have: 

Corollary 1.3. (X,G) is Li-Yorke chaotic if it has positive topological entropy, 
where G is an infinite countable discrete amenable group. 

Note that, using Theorem II. 21 and Theorem [531 Corollary 11.31 is in fact a special 
case of [551 Corollary 8.4], which is explained at the end of the paper. 

As shown by the above results, all actions of a countable discrete group with 
positive topological entropy present very complicated limit behavior of points in the 
system. There are many other such evidences. Since its introduction in [35], the 
homoclinic equivalence relation plays a very important role in the study of actions 
of a countable discrete group on a compact metric space by self-homeomorphisms 
as shown by [TJ [El H31 US HU HS1 [Ml 13S], which was first explored for a shift 
of finite type of a Z d -action (d £ N) by Schmidt [35] Proposition 2.1], Note that 
every expansive Z d -action by automorphisms of a compact zero-dimensional abelian 
group is topologically conjugate to a shift of finite type of a Z d -action [53] ■ For 
an action of the integer group Z, the relationship between topological entropy and 
asymptotic pairs (a variation of the homoclinic equivalence relation in the setting 
of a Z-action) was observed by Blanchard, Host and Ruette in [5]. 

The following result generalizes [35] Proposition 2.1] to a shift of finite type 
for actions of an infinite countable residually finite amenable group (see for a 
detailed introduction of all related definitions). 

Theorem 1.4. Let X C {1, • • • ,m} G be a shift of finite type containing a dense 
set of periodic points, where G is an infinite countable residually finite amenable 
group. Then ( X , G) has positive topological entropy if and only if its homoclinic 
equivalence relation Hx is non-trivial. 

Recall that, if G is a polycyclic-by-finite group acting on a compact abelian 
group expansively by automorphisms, the relationship between topological entropy 
and homoclinic points (another variation of the homoclinic equivalence relation in 
this setting) was discussed recently by Chung and Li in [SJ; and if G is an infinite 
countable discrete amenable group with an algebraic past which includes Z rf for all 
d £ N, the chaotic properties and asymptotic limit behaviors in a G-system with 
positive topological entropy were studied recently by Huang, Xu and Yi in [18] . For 
a group G with the unit eG, by an algebraic past V G G we mean that V satisfies 
V n V- 1 = 0, V U V- 1 U {e G } = G and V ■ V C V. 

The paper is organized as follows. In section 2 we study local weak mixing for 
actions of a general countable discrete group and then prove Theorem ll.2l In section 
3 we give some preliminaries of entropy theory for actions of an infinite countable 
discrete amenable group which will be used in later discussions. In section 4 after 
introducing the notion of a shift of finite type and homoclinic equivalence relation 
for an action of an infinite countable discrete amenable group, we prove Theorem 
11.41 In section 5 we first prove Theorem ll.il and then give some comments of the 
results by Kerr and Li in [55] related to the topic of the present paper. 

2. Weak mixing in countable discrete group actions 

In this section we study local weak mixing for actions of a countable discrete 
group. As a consequence, we prove that the existence of a non-trivial weakly 
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mixing subset implies Li-Yorke chaos, c.f. Theorem 11.21 for details. We also prove 
that each weakly mixing subset in an equicontinuous action must be trivial. 

Recall that (X, G) is a G-system. We say that it is transitive if N(U, V) ^ 0 for 
any non-empty open subsets U,V C X, which is equivalent to say Tran(X, G) ^ 0, 
where Tran(X, G) denotes the set of all transitive points in (X, G), that is, x G 
Tran(X, G) if and only if the orbit of x, Gx = {gx : g G G}, is dense in X. 

The following observation is trivial. For completeness we present a proof here. 

Lemma 2.1. Let (X, G) be a transitive G-system. 

(1) If X is perfect, i.e., contains no isolated points, then for each x G Tran(X,G), 
N(x, U) is an infinite set for any non-empty open subset U C X. 

(2) If X is not perfect then each point of Tran(X, G) is isolated in X. 

Proof. (1) Let U C X be a non-empty open subset. For each F G Tc,-, as X contains 
no isolated points, U \ {/ x : / G F} is also a non-empty open subset, and so there 
exists g G G with gx G U \ {fx : / G F}, which implies N(x,U)\F ^ 0. 

(2) This item is also trivial. Let Xq G X be an isolated point and then let 
x G Tran(X, G). By the definition, it is easy to see gx = Xq for some g G G, 
equivalently, x = g~ 1 XQ. And then the point x is isolated in X. □ 

Similarly to [31] Proposition 3.3], 01., Proposition 2.3], 00] Theorem 4.2], and 
[5] Proposition 4.2] and 00, Proposition 5.2], respectively, we have the following 
characterizations of weakly mixing subsets. 

Proposition 2.2. Let 0 ^ K C X be a closed subset and m G N. 

(1) If K is a non-trivial weakly mixing subset of order 2 then it is perfect. 

(2) If K is weakly mixing of order m, then (Xjf im , G) is a transitive G-system, 
where Xk,ui is the smallest closed G-invariant subset of X m containing 
K m . 

(3) If K is weakly mixing of order 1, then ( Xk,i,G) is a transitive G-system, 
moreover, K n Tran{Xx,i,G) is a dense Gs subset of K. 

(4) If K is non-trivial then (l4al) (14bl) => (l4cl) , where 

(a) K is weakly mixing of all orders; 

(b) there exists B C K, which is the union of countably many Cantor 
subsets, with properties that B is a dense subset of K and for each 
E C B and any continuous mapping h : E —>• K there exists a sequence 
{g n : n G N] C G such that the sequence {g n : n G N} (of mappings 
over X) converges to h pointwise on E; 

(c) for any given finite family of continuous mappings fi : K —> K,i = 
1, • • • ,1 with l G N, there exists an increasing sequence of Cantor sub¬ 
sets Gi C G 2 C • • • C K with properties that the union of {C n : n G N} 
is dense in K and for each i = 1, ■ ■ • , l there exists a sequence {g$ : 
n G N} C G such that the sequence { gn' 1 ■ n G N} (of mappings over 
X) converges to fi uniformly on C s for any sGN. 

Recall that a well-known result by Furstenberg states that weak mixing of order 
2 is equivalent to weak mixing of all orders for actions of an abelian group El- 
While, this is no longer valid for actions of non-abelian groups mm- 

By a Mycielski subset we mean a subset which is the union of a sequence of 
Cantor subsets. The following version of the well-known Mycielski Theorem [29] 
Theorem 1] is very useful in the topological construction of Li-Yorke chaos. 
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Lemma 2.3. Let X be a perfect compact metric space and R n C X Tn a subset of 
first category for each n G N. Then there exists a dense Mycielski set M such that, 
for each n G N, (x,)^ 1 ^ R n whenever x \, • • • , x Tn are r n distinct elements of M. 


In order to prove Theorem II.21 we also need the following useful observation. 

Proposition 2.4. Let K be a non-trivial weakly mixing subset of order n with 
neN \ {1}. Assume that all U\, Vi, ■ ■ ■ , U n , V n are open subsets of X intersecting 
K. Then N(U\ fl K, Vi) fl • • • PI N(U n fl K , V n ) is an infinite subset of G. 

Proof. Observe that, for i— 1, ■ • • ,n,g G G and K, the closure of K, 

g g N(Ui n k, Vi) 4=> Ui n k n g ~ x v,\ ± 0 4=> (Ui n k) n g-'v, ± 0. 

Thus we only need to show that N(U\T\K, Vi)n- • -C\N(U n C\K , V n ) C G is infinite. 

By the assumption one has that K is weakly mixing of order n, and then: K 
contains no isolated points by Proposition ^. 21 (TO: and the sub-G-system (X^ n , G) 
of ( X n ,G) generated by ~K" is a transitive G-system by Proposition 12.21 (El) and 
1T 1 fl Tran(X-^ n ,G) is a dense G$ subset of R n by Proposition 12.21 (l3l). Say 

n 

(xi, ■ • ■ , x n ) G K n 0 Tran(X^ n , G) 0 Ui, 

i= 1 

such a tuple (xi , - • • ,x n ) must exist. As K is perfect, then is also perfect, 
and hence K nTran(JT^ n , G ) contains no points which are isolated in X^ n , thus 
Xjr is perfect by Lemma E7T1 El). Moreover, applying Lemma E7T1 (111) one has that 


fl N(Ui n K, V t ) D f N(x u Vi) = iv (x u • • ■ , x n ), P, 

*=1 2=1 V 2=1 / 

is an infinite set. This finishes the proof. 


□ 


With the help of Proposition 12.41 we can prove the following Proposition 12.51 
and then Theorem 11.21 follows as a direct corollary of Proposition 12.51 

Proposition 2.5. Let 0 ^ I\ C X be a non-trivial closed weakly mixing subset of 
order n,n G N \ {1}. Then there exists a dense Mycielski set M C K such that, 
once xi, ■ ■ ■ , x n G M are distinct and x\, ■ ■ ■ ,x' n G M (need not be distinct), then 


( 2 . 1 ) 


liminf max plqxi.x'f) = 0. 

G9S-KX, i<2<n 11 


Proof. We shall construct a dense Mycielski subset M C K such that (EH) holds 


when all points Xi,x[,- 


G M are distinct. Note that K is a non-trivial 


closed weakly mixing subset of order n , K contains no isolated points by Proposition 
EHO, and hence its dense Mycielski subset M contains no isolated points. From 
which it is easy to check that the constructed subset M satisfies the conclusion. 

In Tg w e take a sequence E\ C E 2 C • • • with union G. For each k G N we put 


Sk = \ (zi, • • • ,x n ,x 


i, • • • , x 'n) G K 2n : inf max p(gx u x'f) < - 1. 

g£G\Ek /c J 


Obviously, Sk C K 2n is an open subset. In fact, Sk C K 2n is also dense, as: once 
- ■ ■ ,U n ,V n are non-empty open subsets of X intersecting K , by shrinking 
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we could assume additionally that the diameters of all subsets V \, • • • . V n are at 
most 577 , then 

n 

D N (Ui n k , Vi) \E k ^<b 

i= 1 

by Proposition 12.41 and so we could choose 

n n 

(x\ 5***5 Xfi 5 X\ 5 5 *^77,) £ n II<c< nfsT) x n« nif). 

1=1 4=1 

Thus S' is a dense Gs subset of K 2n , and for each (an, • • ■ , x n , x[, ■ ■ ■ , x' n ) £ S, 
liminf max p(gxi,x[) = 0, where S = (| Sfc. 

G3q—too l<i<n 

fceN 

Now applying Lemma 12.31 to K 2n \ S we obtain a dense Mycielski subset M C K 
such that (an, • • • , x„, x \. • • • , £ S once all points an, X]., ■ • • , x n , x' n £ M are 

distinct. This finishes the proof of the conclusion. □ 

Similarly, we have the following result, whose proof is left to the reader. 

Proposition 2.6. Let 0 ^ K C X be a non-trivial closed weakly mixing set of all 
orders. Then there exists a dense Mycielski set M C K such that, for each n £ N, 
once an, ■ • • , x n £ M are distinct and x[, ■ ■ ■ ,x' n £ M (need not be distinct), then 

liminf max p(qx;,x'f) = 0 . 

G3 S ^ool<i<n 11 

We say that ( X , G ) is equicontinuous if for each e > 0 there exists <5 > 0 such 
that d(x 1 , 3 : 2 ) < 5 implies d(gx\, gx^) < e for all g £ G. In the following we discuss 
the local weak mixing in an equicontinuous system. 

By a cover of X we mean a family of subsets of X with union X. If elements 
of a cover are pairwise disjoint, then it is called a partition. Denote by Cx,Cx and 
Vx the set of all finite Borel covers, finite open covers and finite Borel partitions of 
X, respectively. Let Vi, V 2 £ Cx- We say that Vi is finer than V 2 if each element 
of Vi is contained in some element of V 2 , which is denoted by Vi >z V 2 - For F £ Tq 
and 0 7 ^ K c X we set (Vi)f = V g eF an d set N(Vi,K) to be the minimal 

cardinality of sub-families of Vi covering K , we set N(V 1 ,0) = 0 by convention. 
Then similar to [5] Proposition 2.2] and pH] Proposition 3.7] we have: 


Proposition 2.7. (X,G) is equicontinuous if and only if for each IA £ C\ 
exists M < 00 such that N(Uf,X) < M for all F £ Fq- In this case, 
0 ^ K C X is a weakly mixing subset of order 2 then K must be trivial. 


there 


3. Preliminaries for entropy of amenable group actions 

In this section we give some preliminaries of entropy theory for actions of an 
infinite countable discrete amenable group which will be useful in later discussions. 

From now on, we will assume additionally that G is an infinite countable discrete 
amenable group. Recall that a countable discrete group G is amenable if there exists 
a sequence {F n : n £ N} C Fq such that 

\gF n AF n 


lim 

n—¥ 00 


I F n 


= 0 
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for each g £ G, which is equivalent to mean that 


n->oo LF„ 


for each K £ Fa, here we denote by | • | the cardinality of a set •. Such a sequence 
{F n : n £ N} is called a Fglner sequence of G. In particular, 


Fn — a n] i T 1, 


l,i + bn,i 1}, Tl £ M 


will define a typical Fplner sequence for amenable groups Z d with dsN when 

d 

lim min&„ .• = oo. 

n->oo i=1 ’ 


The class of countable discrete amenable groups includes all solvable groups. 

We will fix {F n : n £ N} C Fa to be a Fglner sequence of the infinite countable 
discrete amenable group G till the end of the paper. 

Let Id £ C° x . Recall that the topological entropy of Id is defined as 

(3.1) h top (G,U) = lim —!—log N(hl Fn ,X). 

n->oo \t n \ 

As guaranteed by the well-known Ornstein-Weiss Lemma [28] Theorem 6.1], the 
limit is well defined and independent of the selection of a Fplner sequence {F n : 
n £ N} C Fc- Then the topological entropy of (X, G ) is defined as 


(3.2) 


hto P (G, X) = sup h t 0 p(G,V). 


Moreover, let 0 ^ K C X, we define the topological entropy of K as 


h top (G, I\) = sup lim sup —— log N(V Frl ,K). 

n—>oo n\ 


And so if K is a finite non-empty set then h top (G,K)=0. 

Denote by M(X) the set of all Borel probability measures on X; by M(X,G) 
the set of all G-invariant elements p in M(X), i.e., p(A) = p(g~ 1 A) for each g £ G 
and all A £ Bx , where B x is the Borel a -algebra of X; and by M e (X, G) the set of 
all ergodic elements v in M(X, G), i.e., for A £ Bx, A = gA for all g £ G implies 
v{A) = 0 or 1. Note that M e (X,G) ^ 0 always holds for an amenable group G. 
For p £ M(X), denote by supp(//) the support of p, the smallest closed non-empty 
subset K C X with p(K) = 1. It is basic that if p £ M(X, G) then swpp(p) is G- 
invariant and hence (supp(/x), G) is a G-system, and, additionally, if p £ M e (X, G) 
then the G-system (supp(/z),G) is transitive and in fact /r(Tran(supp(/r), G)) = 1. 

Let A C Bx be a sub-cr-algebra and p £ M{X),a £ Vx- Set 

HMA) = -Y j I E m (1a|A) log E li (lA\A)dfjb, 

AtJ X 


where E M (ln|A) denotes the //-expectation of the function 1 ^ with respect to A; 
and then for the trivial sub-cr-algebra A f = {0, X}, we set 

Hy.{a) = H p (a\N) = - ^ p(A) log p(A). 

AGa 
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In general, for U £ Cx, we set without any ambiguity 


H,(U\A)= inf HM*)- 

qG?x ,olcM 


Now let g £ M(X,G),A C Bx be a G -invariant sub-cr-algebra (in the sense of 
gA = A mod g for each g £ G) and U £ Cx- Recalling from [T9], we may define 
the measure-theoretic g-entropy ofU relative to A as 

(3.3) h lx (G,U\A) = lim —(= inf /i M (G,a|.A)V 

n—>oo \r n \ \ olGVx ,olHA J 

and the measure-theoretic g-entropy ofU as 


K(G, U) = hp(G,UW) 


lim 

n—> oo 


| F n 


H u( u F n ) (= inf hn(G, a) 


a€Vx ,ot>U 


respectively, where the latter equalities follow from m Theorem 3.2] and [TOl 
Theorem 4.14], respectively. Similarly to (13.11) . these limits are well defined and 
independent of the selection of a Fplner sequence {F n : n £ N} C Tq- Then the 
measure-theoretic g-entropy of ( X , G ) is defined as 


(3.4) h li (G,X)= sup h^G,a) = sup h^(G,U) , 

ol^lPx y U.€lC° x J 

where the second identity follows from Em Theorem 3.5]. For each U £ C x , one of 
the main results of [T9], [19] Theorem 5.1], shows that 

htov(G,U) = max h u {G,U) = max hAG,U ), 

H£M(X,G) m eM e (JC,G) 

and hence combined with (13.21) and (13.41) one has 

(3.5) h top (G,X) = sup h li {G,X)= sup h^(G,X). 

/i£ M(X,G) ii£M e (A',G) 

For g £ M ( X , G) and a G-invariant sub-cr-algebra A C Bx , we define 
P^G\A) = {A £ B x : h^G, {A, X \ z4}|.4) = 0}. 

By the definition, A U I x C P M (G|^4), where I x denotes the set of all G-invariant 
Borel subsets of X. It is well known that P M (G|.4.) = P M (G|P M (G|^4)) and P M (G|.A) C 
Bx is a G-invariant sub-cr-algebra containing A, which is called the Pinsker a- 
algebra of g relative to A. In particular, we set P p (G) = P /1 (G|jV) (and hence 
P^(G) = P M (G|P M (G))) and call it the Pinsker a-algebra of g. Moreover, for a £ V x 
and U £ Cx, one has (observing (13.3D ) 


(3.6) h^(G,a) = h^(G,a\Pfj(G)) and hence h^GM) = h l _ l (G,U\P tJ ,(G)). 

Now for each n £ N \ {1}, following ideas from [T5], IT)], we could introduce a 
probability measure A „ ifl over ( X n , B x ) by, for all A\, ■ ■ ■ ,A n £ Bx, setting 

( n \ r. n 

II* = / Y[E^(l Ai \P,(G))dg. 

1 = 1 J Jx z—1 

In fact, observing the G-invariance of P M (G) one has M £ M(X n ,G). 

Then we have the following observation: 


Proposition 3.1. Let g £ M e (X, G) and n £ N \ {1}. Then 

( 1 ) h Xn JG,X n )=nh fl (G,X). 

(2) \ n ,n £ M e (X n ,G) (and hence (supp(\ n ^),G) is a transitive G-system). 
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(3) If h fl (G,X) > 0 then A„ jA1 (A n ) = 0, where A n = {(*!,••• , x n ) : x\ = 
= Moreover, if let g = f x g x dg(x) be the disintegration of 

g over its Pinsker a-algebra P fl (G), then: for /i-a.e. x £ X, g x is non- 
atomic (and hence supp{g x ) contains no isolated points) and supp(g x ) n PI 
Tran(supp(\ n ^),G) is a dense subset of supp(g x ) n . 

Proof. (1) The proof is similar to that of [12] Lemma 3.1]. 

(2) The proof is similar to that of [TH] Lemma 4.3]. Let n n : X n —X be the 
projection {x\,--- ,x n ) H > x\. By applying n — 1 times of t L7!, Theorem 4] we 
obtain T > A„ i ^(G|7r^ 1 P M (G)) = n~ 1 P ll (G) (in the sense of mod A rai/i ), that is, apply 
jlTl Theorem 4] to obtain it for A 2 iA1 and then apply [17] Theorem 4] to obtain it 
for ^ 3 ,a»; and so on. Now let A n C X n be any G-invariant Borel subset. Then 
A n £ P\ n ,^.(G\TT~ 1 P fl (G)), and hence A n = 7 t~ 1 (G) mod A„ iAt for some G £ Bx- 
Then, by combining with the G-invariance of A n and 7r n A njAl = g, we obtain 

m(jGAG) = A n , / ,(^- 1 ( 5 GAG)) = A„, /i (7T- 1 ( ff G)A^- 1 G) 

= Xn^tgir- 1 = \ n ^(gA n AA n ) = 0 

for each g £ G, and hence A n ,^{A n ) = A„ i/i (7r“ 1 G) = g[C) takes value of either 0 
or 1 by the ergodicity of g. In particular, A„£ M e {X n , G). 

(3) Now assume h^{G,X) > 0. First we prove \ n ^(A n ) = 0. Else, by the 
G-invariance of A n one has A„^(A n ) = 1, and hence, for each A £ Bx and set 
Ai = A, A 2 = X \ A and A 3 = ■ ■ ■ = A n = X , one has 

( n \ ,, n 

n* = / 

i=1 ) ■* x t=l 

= [ E M (l A |P M (G))-E / 1 (l x \ A |P M (G))dAi 

J x 

= [ E M (U|P M (G))-[l-E M (U|i , M (G))]dAi, 

■lx 

and hence E /i (l J 4 |P A1 (G)) = 1 a mod g, equivalently, A £ P M (G). Thus, P M (G) = 
Bx, a contradiction to the assumption h^G, X) > 0. 

Observing that by the construction and the assumption, we have 

A„,At = / H x dg(x) and hence A„ iM (A n ) = / {g%)(A n )dg(x), 

Jx J x 

which implies ( g x )(A n ) = 0 and then g x is non-atomic for g- a.e. x £ X. Moreover, 
by the conclusion of A njM £ M e {X n , G) we obtain 

1 = A„, M (Tran(supp(A n , M ),G)) = / (/z”)(Tran(supp(A njM ), G))dg(x), 

Jx 

and so, for g- a.e. x £ X, (/z")(Tran(supp(A rl , At ), G)) = 1, which implies the density 
of supp (g x ) n O Tran(supp(A„ iM ), G) in supp]/^)", as supp (gf.) = swpp(g x ) n . □ 

4. Homoclinic equivalence relation in a shift of finite type 

FOR AMENABLE GROUP ACTIONS WITH POSITIVE ENTROPY 

Asymptotic limit behaviors in an action with positive topological entropy was 
observed for a Z-action in [1], for a shift of finite type of Z d -actions (d £ N) in [35] 
and for an algebraic action in a series of papers 0 m m na mi na Gnu , respec¬ 
tively. In this section we study asymptotic limit behaviors of a shift of finite type 


10 


Chaotic Behavior of Group Actions 


with positive topological entropy for a general infinite countable discrete amenable 
group. The main result of this section is Theorem If .41 which is a direct corollary 
of Proposition [TT] and Proposition ^. 21 Note that the proofs of Proposition l4.il and 
Proposition 14.21 are inspired by that of [351 Proposition 2.1], 

First let us introduce a shift of finite type for actions of a general amenable 
group. Let m £ N\ {1} and fix it in this section. Then ({1, • • - ,m} G ,G) is a 
G-system, where G acts naturally over the compact metric space {1, ■ ■ • , m} G by 

g'(x g : g £ G) = ( x ggl : g £ G). 

By a sub-shift we mean a closed G-invariant non-empty subset X C {1, ■ ■ ■ , m} G , 
i.e., gX = X for each g £ G. In this case, we will also say that (X, G) is a sub¬ 
shift. For each F £ Fa, denote by 7 t f : {1, ■ • ■ , m} G — > {1, • • • , m} F the natural 
projection. Then it is easy to check that the topological entropy of a sub-shift 
(X, G) can be defined equivalently as 

(4-1) h top (G, X) = lim JLk>g|7r Fn (X)|. 

n-)-oo |F„| 

A sub-shift X is called a shift of finite type if 

X = {(x g ) seG : n F o g'{x g : g £ G) £ X F for each g' £ G} 

for some X F C {1, • • • , m} F with F £ Fg, equivalently, 

X = {(x g ) g&G ■ (a - gg ') g e F 6 X F for each g' £ G}. 

As shown by [25] Proposition 3.12 and Theorem 5.2] (see also [251 Theorem 3.2]), 
each expansive Z d -system with d £ N by continuous automorphisms of a compact 
zero-dimensional abelian group is topologically conjugate to the shift-action of h d 
on a shift of finite type. Here, we mean (X, G) expansive if there exists S > 0 such 
that, for all different points x\ and x% in X, p(gx\, gx 2 ) > 6 for some g £ G. 

The homoclinic equivalence relation Hx of a sub-shift X is defined by, for x = 
(x g : g £ G) £ X and x' = {x' g : g £ G) £ X, ( x,x') £ Hx if and only if there 
exists F £ Fg such that x g = x' g for all g £ G \ F, equivalently, for each e > 0 
there exists E £ Fg with the property of p{hx, hx') < e for each h £ G\E. 

For a shift-action of T, d on a shift of finite type X, [35] Proposition 2.1] shows 
that Hx must be non-trivial in the sense of ( x,x r ) £ Hx for some x x' \i the 
sub-shift X has positive topological entropy. The following result shows that in 
fact it holds for a sub-shift of actions of a general amenable group. 

Proposition 4.1. Let X C {1, • • • ,m} G be a shift of finite type with positive 
topological entropy. Then Hx is non-trivial. 

Proof. By the assumption, we let X F C {1, • • • ,m} F with F £ Fq such that 

x = {(a 'g)geG ■ (x gg ')gfz F £ X F for each g' £ G}. 

Assume the contrary that Hx is trivial, i.e., for x,x' £ X, ( x,x ') £ Hx if and 
only if x = x' . Then for all x,x' £ X and each E £ Fg, say x = (x g : g £ G) and 
x' = ( x' g : g £ G), once x g = x' g for all g £ EnFF~ 1 E c , we have that x agrees with 
x' over E (which will be proved later), which implies that ^ te{X) = n EnFF -i E c(X) 
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for each E £ Eg- Thus, according to m, we have 

h top (G,X) = lira T ^-log|7r F „(X)| = lim —— log \n FnnFF -i F c{X)\ 
n^too |F„| n-^oo \F n \ 

< logm • limsup —!—|.F„ C FF^F^ = 0, 

n —>-00 \-r n\ 

a contradiction to the assumption that ( X , G) has positive topological entropy. 

Thus it remains to show that, for any given x,x' £ X and E\ £ Eg (fix them), 
say x = (x g : g £ G) and x' = {x' g : g £ G ), if x g = x' g for all g £ E\ n FF~ 1 Ef, 
then x agrees with x' over the whole E\. Assume the contrary that x agrees with 
x' over Ei fl FF~ 1 Ef but not over E\. We may choose y £ {1, • • - , m} G \ {a;} with 
y g = x' g for each g £ E\ and y g = x g for each g £ E^. Recalling x, x' £ X, one has: 

(1) For any g' F~ 1 E J, Fg' C Ei and so {y gg ') gFF = (x gg ,) geF £ X F . 

(2) For any g' £ F~ 1 E^ and let g £ F: if gg' £ E\ then gg' £ Ei<lFF~ 1 E^ and 
so y gg i = x' gg , = x gg ' (observe that x agrees with x' over E\ fl FF~ 1 Ei ), 
and if gg' £ E x then y ggl = x gg >. Summing up, (y gg >) g( z F = ( x gg >) geF £ X F 
for each g' £ F~ 1 Ei. 

This implies y £ X, and so (x, y) £ Hx by the construction, a contradiction to the 
assumption that Hx is trivial. This finishes the proof. □ 

The converse of Proposition 14.II holds true when the action is good enough and 
the infinite amenable group G is residually finite as shown by Proposition 14.21 
Recall that a countable group is residually finite if the intersection of all its 
normal subgroups of finite indexes is the trivial group {ec}, where ec is the unit 
of the group G. Each finitely generated nilpotent group is residually finite. Let 
x £ X. It is easy to see that G x = {g £ X : gx = x} is a subgroup of G. We say 
that x £ X is periodic if Gx C X is a finite subset, which is equivalent to say that 
the subgroup G x has a finite index with respect to G. 

As shown by Pf[ Theorem 1.3], [TO], Theorem 5.7], [26', Theorem 1.1] and [27] 
Theorem 7.1], the concept of periodic points is quite related to the topological 
entropy for many algebraic actions of a residually finite group. And the connection 
between periodic points, topological entropy and homoclinic equivalence relation 
for a shift-action of T, d on a shift of finite type was explored in [35]. Observe that, 
even only considering a shift-action of T, d for a general d > 1, a shift of finite type 
may not contain any periodic point and this potential absence of periodic 

points is associated with some of the difficulties one encounters when dealing with 
shifts of finite type in higher dimensions as shown in [35] . 

Now we can provide the converse of Proposition 14. II in some sense as follows. 

Proposition 4.2. Let X C {1, - - - , m} G be a shift of finite type with zero topological 
entropy, where G is an infinite countable residually finite amenable group. Assume 
that X contains a dense set of periodic points. Then Hx is trivial. 

Proof. By the assumption, we let X F C {1, • • • , m} F with F £ Eg such that 
x = {( x g ) geG ■■ ( x g g') gGF £ X F for each g' £ G}. 

Now we assume that Hx is non-trivial. In the following we shall prove the conclu¬ 
sion by showing that in this case ( X , G) has positive topological entropy. 

As G is an infinite countable residually finite amenable group, by applying [9[ 
Lemma 5] which is due to B. Weiss (see also [TOi Corollary 5.6] or [38] Theorem 
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1 ]), we could choose a sequence {G n ■ n £ N} of normal subgroups of G with finite 
indexes and a Fplner sequence {F n : n £ N} of G such that 

( 1 ) {G n ■ n € N} decreases to the trivial group { ec }, 

(2) {F n g : g £ G n } forms a partition of G for each n £ N, and 

(3) the sequence ec £ F\ C F 2 C ■ ■ ■ increases to the whole group G. 

Observe that Hx is non-trivial, in X we could choose different points x = (x g : g £ 
G ) and x' = ( x' g : g £ G) and N £ N such that x g = x' g for all g £ G\Fn (and hence 

ttf n (x) ^ np N (x')). As the sequence FI C F 2 C • • • increases to G, there exists 

M > N with FF~ 1 Fn C Fm (and hence i tf m (x) ^ ttp m (x')). And finally, because 
that X contains a dense set of periodic points, we could select a periodic point 
y = (y g : g £ G) £ X with np M (y) = tt Fm ( x )- Observe that Q = {g £ G : gy = y} 
is a subgroup of G with a finite index (as y is a periodic point). 

As {FmS : g £ Gm} forms a partition of G, for each z = {z s : s £ Q C I Gm) £ 

{0, l}Q nGM , there exists uniquely a point x z = (x z : g £ G) £ {1, • • • , m} G with 

7r f m ( sx z ) = 7 Tp M {x) for each s £ Q C\ Gm with z s = 0, 

np M (sx z ) = ttf m (x') for each s £ Q 0 Gm with z s = 1, 

x g = y g for each g £ G \ F M (Q O G M ). 

In fact, x g = y g for each g £ G \ Fn(Q fl Gm)- by the above construction we 

only need to check it for each g £ Fm{Q H Gm) \ Fn(Q fl Gm), say g = Ir with 
r £ Q fl Gm and l £ Fm (and hence l £ FV), 

Xg = xf r = ( rx z )i = Xi or x[, 

depending on z r = 0 or 1 , thus (observing x[ = xi = yi by l £ Fm \ Fn) 
x g=yi = ( r y)i (as r £ Q) = yi r = y g . 

Thus the constructed point x z belongs to the shift X: 

• if g' £ F~ 1 Fn(Q H Gm), say g' = ft with t £ Q C I Gm and / £ F~ 1 Fn, 
then F f C Fm by the construction and hence 

( x gg')g£F = i x g ft)g£F = {{tx )gf)g£F = ( x gf)g£F or (x g f)g£F, 

depending on z t = 0 or 1, which implies (x z g ,) gf zF £ Xp because x, x' £ X\ 

• if g' £ F~ 1 Fn(Q D Gm) then gg' £ Fn(Q H Gm) for each g £ F and so 
( x gg ')g&F = {ygg 1 ) g p f £ Xp by the above constructions (observing y £ X). 

Now we aim to estimate the topological entropy of (A, G) as follows. 

Firstly, observe that Gm is a normal subgroup of G with a finite index and Q 
is a subgroup of G with a finite index. It is basic to see that Q fl Gm is a normal 
subgroup of Q , Gm is a normal subgroup of GmQ (observing GmQ is a subgroup 
of G) and the quotient groups ( GmQ)/Gm and Q /(QGGm) are isomorphic. Thus 
Q (~l Gm is a subgroup of Q with a finite index, and hence a subgroup of G with a 
finite index, which implies that Fp(Q fl Gm) = G for some L > M. 

Now fix each K > M. On one hand, for any given z = (z s : s £ Q C I Gm) £ 
{ 0 ,i}Q n G M an d z ' = ( z ' s : s £ Q n G M ) £ { 0 ,l} <3nG ' M , if ^ z{ for some 
£ £ Q fl Gm with C FV, say z^ = 0 and z{ = 1, then 

ff m {£,x z ) = tt Fm (x) ^ 7 t Fm {x') = tt Fm (£x z ) (observing tt Fm (x) 7 ^ tt Fm (x')), 
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which implies ttf k {^x z ) ^ ttf k (£x z ) (observing K > M), that is, ff k {£,x z ) and 
7 i" Fk (£x z ) are two different elements of ttf k {X). In particular, 

(4.2) \-kf k {X)\ > 2^Q nGM '- F L9 cFK }\. 

On the other hand, as Fl{Q 0 Gm) = G, it is easy to see 

(4.3) \{ge Q nG M : FLg n FK ^«)}\ > ^, 

Fi I 

and hence 

|{<7 £ Q n Gm ■ F Lg c Fk}\ > \{g s Q n Gm ■ F Lg n Fk ^ 0}| — 

\{g £ G : F Lg 0 Fk ^ 0 and Fjjg D F^ ^ 0}| 

(4.4) ~ W\~ WllPK 0 (aPplying <ra) ' 

Combining (14.21) and (14.41) with dun we obtain 

hto P (G, X) = lim —log| 7 r FK (X)| 

K-t-oo \r k\ 

1 log 2 

> log 2 • lim inf —— | {g £ Q D G M : F L g C F K }\ > tttt > 0 
K->oo IKK] \F L \ 

which finishes the proof, where the last inequality follows from the estimation (14.41) 
and the fact that {F n : n £ N} is a Fplner sequence of G. □ 

5. Weak mixing in amenable group actions with positive entropy 

The relationship between positive topological entropy and (local) weak mixing 
has been explored in 0 H2 EU [32j for a Z-system. It is natural to ask if these 
results can be generalized to a G-system for a general amenable group. The answers 
turn out to be affirmative. For example, m Theorem 7.8] tells us that X is weakly 
mixing of all orders if ( X , G) has uniformly positive entropy (see [19] for the detailed 
definition of uniform positive entropy for actions of an infinite countable discrete 
amenable group). In this section first we aim to prove Theorem 11.11 that (local) 
weak mixing exists indeed in such an action with positive topological entropy. 
Before proceeding, we need the following basic facts. 

Lemma 5.1. Let (X,G) be a transitive G-system and 0 ^ K C X. Assume that 
K n Tran(X,G) is a dense subset of K. Then K is weakly mixing of order 1. 

Lemma 5.2. Let g £ M(X) and U £ Cx- Then H^{U) < log NfU, supp(n)). 

Then Theorem 11.11 comes from (13.51) and the following result. 

Proposition 5.3. Let p £ M e (X,G) with h^(G,X) > 0, and say p = J x p x dg(x) 
to be the disintegration of p over its Pinsker cr-algebra P^(G). Then supp(p x ) is a 
non-trivial weakly mixing subset of all orders for p-a.e. x £ X, and 

(5.1) h fl (G, X) < ess — sup h top {G, supp(p x )) with ess — sup = inf sup. 

p M AgBx,m(A)=1 xe A 

Proof. Applying Proposition 13.11 we know that: for p-a.e. x £ X, p x is non- 
atomic (and hence supp(/^, x ) is non-trivial), and, for each n £ N, supp {p x ) n D 
Tran(supp(A„ iAl ), G) is a dense subset of supp^a,)" (in particular, supp (p x ) n C 
supp(A n ,fi)) and hence supp (p x ) n is weakly mixing of order 1 by Lemma 1 5. 11 which 
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is equivalent to say that supp(/Za;) is weakly mixing of order n. This implies that 
supp(/Z 2 ;) is a non-trivial weakly mixing subset of all orders for p-a.e. x £ X. 

Now let U £ Cx , first we aim to prove 

(5.2) h,j(G,l() < ess - sup limsup —logTV^^supp^)). 

p, n—>■ oo \-T n\ 

In fact, with the help of Lemma 15. 2 1 it is easy to obtain (15.21) as follows: 


K(G,U) = 

(5.3) 


< 


< 


h IJ ,(G,U\P IJ ,(G)) (using EH])) 

1 H^UfMG)) = Jim 1 


lim 

rn-oo |F„| 


n —foo \F 


H uS U F n )dp{x) 


n | JX 


limsup — (JAF n )dii{x) < ess — sup limsup (Z/F n ) 


IX n—too 


F n 


| F n 


ess — sup limsup r—r log N{U.F n , supp(/U x )), 

/x n—>oo \* i n\ 


where the second identity of (15.31) is well known (see for example [TT] Lemma 3.13]). 
Now we take a sequence {U n : n £ N} C C^- with the diameters of U n tending to 0. 
Then with help of (13.41) . (15.11) follows by firstly applying (15.21) to each U n and then 
taking the limit as n tends to infinity. This finishes the proof. □ 


As shown by [T9] and the above arguments, the proofs of m Theorem 7.8] and 
Theorem 11.11 both use ideas from ergodic theory. Recently, using mainly combi¬ 
natorial and topological methods, in [22] Kerr and Li undertook a local analysis 
of combinatorial independence which connects to topological entropy within the 
framework of actions of sofic groups. At the end of this section, we shall give 
some comments about its relationship with the topic of the present paper using the 
languages of [22] • See [22j for a detailed introduction of related discussions. 

When considering a G-system (X, G) where G is an infinite countable discrete 
sofic group, Kerr and Li proved that positive (sofic) topological entropy also im¬ 
plies Li-Yorke chaos j22] Corollary 8.4], and then the system (X, G) has at most 
zero (sofic) topological entropy if the space X contains at most countably many 
points. Note that [22] Corollary 8.4] (and [22] Theorem 8.1]) are stated for the 
sofic topological entropy defined using ultrafilter. However, the limsup versions of 
them follow directly from the ultrafilter versions, since one can pass to a subse¬ 
quence where the quantity converges and then one can use any free ultrafilter on 
this subsequence. 

Due to lack of space, the definition of sofic group is omitted here. See |22] for 
the detailed definition of soficity for a group and the introduction of entropy theory 
for actions of countable discrete sofic groups (see also [6] [2T] for the entropy theory 
for actions of countable discrete sofic groups). 

Generalizations of [T9] Theorem 7.8] and Thcorem ll.ll to actions of a more general 
infinite countable discrete sofic group were proved in fact implicitly in [ 221 . 


Proposition 5.4. Assume that G is an infinite countable discrete sofic group and 
(X, G) has uniformly positive entropy (with respect to some fixed sofic approxima¬ 
tion sequence Ti), i.e., IE^^XjG) = IE^(X 7 G) = X 2 in the language of [22] 
Definition 4.3 and Remark 4.4]. Then X is a weakly mixing set of all orders. 

Proof. We shall prove the conclusion by showing that (X m , G) is transitive for each 
mSNby induction over m £ N. Let m £ N. In fact, recalling that G is infinite and 
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observing j22j Definition 3.2], it suffices to prove that IE 2 (X rn 1 G) = X 2m . First 
we consider the case of m = 1. Observing X 2 = IE^{X 7 G) = IE^^X, G) by the 
assumption, IE 2 (X,G) = X 2 follows from [22] Proposition 4.6]. Now we assume 
that IE 2 (X k , G ) = X 2k for some fc £ N, we consider the case of m = k+ 1. In fact, 
it follows directly from [22] Theorem 3.3] that 

IE 2 {X k+1 ,G) = IE 2 (X k ,G) x IE 2 (X,G) = X 2k x X 2 = X 2{k+1) . 

This shows that IE 2 (X m , G) = X 2m for each to £ N, which finishes the proof. □ 

Theorem 5.5. Assume that G is an infinite countable discrete sofic group and 
(X,G) has positive (sofic) topological entropy (with respect to some sofic approxi¬ 
mation sequence). Then it admits a non-trivial weakly mixing subset of all orders. 

Proof. Applying [25] Proposition 4.16 and Theorem 8.1] to the assumption, there 
exists a Cantor subset K C X (and hence non-trivial) such that: for all m £ N, 
once xi, ■ ■ ■ , x m £ K are distinct and x \, • • • , x' m £ K (need not be distinct), then 

(5.4) lirninf max p(gxi, x[) = 0. 

G3g—t oo l<i<m 

From this we have that K is a non-trivial weakly mixing subset of all orders: let 
m £ N, and let U\, V), • ■ • , U m , Vm be open subsets of X intersecting K, obviously 
we could choose distinct points Xi £ Ui fl K and x\ £ V) PI K for each i = 1, • • • , to 
( observing that K is a Cantor set), and then by (15.411 we choose g £ G such that 
maxi<i< m p(gxi,x' i ) is small enough and so gXi £ V) for each i = !,••• , to, that is, 
g £ N{U\ fl K , Vi) fl • • • fl N(U m fl K , V m ), finishing the proof. □ 
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